Tuning parameter selection for penalized estimation via R2
نویسندگان
چکیده
The tuning parameter selection strategy for penalized estimation is crucial to identify a model that both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation) tend select models with more predictors than necessary. A simple yet powerful cross validation proposed which based on maximizing the correlation between observed predicted values, rather loss purposes of support recovery. can be applied all least-squares estimators and, under certain conditions, metric implicitly performs bias adjustment named α-modification. When Lasso estimator, α-modification closely related relaxed estimator. approach demonstrated functional variable problem optimal placement surface electromyogram sensors control robotic hand prosthesis.
منابع مشابه
Tuning Parameter Selection for Penalized Likelihood Estimation of Inverse Covariance Matrix
In a Gaussian graphical model, the conditional independence between two variables are characterized by the corresponding zero entries in the inverse covariance matrix. Maximum likelihood method using the smoothly clipped absolute deviation (SCAD) penalty (Fan and Li, 2001) and the adaptive LASSO penalty (Zou, 2006) have been proposed in literature. In this article, we establish the result that ...
متن کاملTuning parameter selection in high dimensional penalized likelihood
Determining how to select the tuning parameter appropriately is essential in penalized likelihood methods for high dimensional data analysis. We examine this problem in the setting of penalized likelihood methods for generalized linear models, where the dimensionality of covariates p is allowed to increase exponentially with the sample size n. We propose to select the tuning parameter by optimi...
متن کاملPenalized Bregman Divergence Estimation via Coordinate Descent
Variable selection via penalized estimation is appealing for dimension reduction. For penalized linear regression, Efron, et al. (2004) introduced the LARS algorithm. Recently, the coordinate descent (CD) algorithm was developed by Friedman, et al. (2007) for penalized linear regression and penalized logistic regression and was shown to gain computational superiority. This paper explores...
متن کاملShrinkage Tuning Parameter Selection in Precision Matrices Estimation
Recent literature provides many computational and modeling approaches for covariance matrices estimation in a penalized Gaussian graphical models but relatively little study has been carried out on the choice of the tuning parameter. This paper tries to fill this gap by focusing on the problem of shrinkage parameter selection when estimating sparse precision matrices using the penalized likelih...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computational Statistics & Data Analysis
سال: 2023
ISSN: ['0167-9473', '1872-7352']
DOI: https://doi.org/10.1016/j.csda.2023.107729